Kimera: From SLAM to spatial perception with 3D dynamic scene graphs

نویسندگان

چکیده

Humans are able to form a complex mental model of the environment they move in. This captures geometric and semantic aspects scene, describes at multiple levels abstractions (e.g., objects, rooms, buildings), includes static dynamic entities their relations person is in room given time). In contrast, current robots’ internal representations still provide partial fragmented understanding environment, either sparse or dense set primitives points, lines, planes, voxels), as collection objects. article attempts reduce gap between robot human perception by introducing novel representation, 3D scene graph (DSG), that seamlessly metric environment. A DSG layered where nodes represent spatial concepts different abstraction, edges spatiotemporal among nodes. Our second contribution Kimera, first fully automatic method build from visual–inertial data. Kimera accurate algorithms for simultaneous localization mapping (SLAM), metric–semantic reconstruction, object localization, pose shape estimation, parsing. third comprehensive evaluation real-life datasets photo-realistic simulations, including newly released dataset, uHumans2, which simulates crowded indoor outdoor scenes. shows achieves competitive performance SLAM, estimates an mesh real-time, builds with tens objects humans minutes. final showcase how use real-time hierarchical path-planning. The core modules have been open source.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Scene statistics and 3D surface perception

The inference of depth information from single images is typically performed by devising models of image formation based on the physics of light interaction and then inverting these models to solve for depth. Once inverted, these models are highly underconstrained, requiring many assumptions such as Lambertian surface reflectance, smoothness of surfaces, uniform albedo, or lack of cast shadows....

متن کامل

3D Scene Comparison using Topological Graphs

New technologies for shape acquisition and rendering of digital shapes have simplified the process of creating virtual scenes; nonetheless, shape annotation, recognition and manipulation of both the complete virtual scenes and even of subparts of them are still open problems. In this paper we deal with the problem of comparing two (or more) object sets, where each model is represented by an att...

متن کامل

Learning Spatial Knowledge for Text to 3D Scene Generation

We address the grounding of natural language to concrete spatial constraints, and inference of implicit pragmatics in 3D environments. We apply our approach to the task of text-to-3D scene generation. We present a representation for common sense spatial knowledge and an approach to extract it from 3D scene data. In text-to3D scene generation, a user provides as input natural language text from ...

متن کامل

6D SLAM with Kurt 3D

technology, equipment and applications related to the automated assembly and robotics industries. Feature articles include updates on the latest manufacturing research, tutorials on a particular manufacturing technology and field reports on installed manufacturing technologies, all from a technical perspective. Each issue also includes additional brief articles, product announcements and event ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: The International Journal of Robotics Research

سال: 2021

ISSN: ['1741-3176', '0278-3649']

DOI: https://doi.org/10.1177/02783649211056674